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1.0  INTRODUCTION 


Many  real-time  computing  systems  continue  to  utilize  the  central¬ 
ized  computer  system  architecture  concept  where  several  subsystems  are 
integrated  to  function  under  an  executive  program  in  a  mainframe 
digital  computer.  While  this  approach  had  certain  advantages  years 
ago  when  hardware  costs  were  high  compared  with  software  costs,  the 
concept  has  proven  to  have  many  disadvantages.  Now  that  hardware 
costs  have  been  reduced  relative  to  software  costs,  a  potential 
solution  is  to  develop  a  distributed  computing  system  design  where  the 
system  functions  and  data  base  are  partitioned  into  several  mini¬ 
computers  or  microcomputers  connected  in  a  system  network  and  under 
the  control  of  a  distributed  operating  system. 

Communi cation  networks  may  conveniently  be  categorized  as  circuit 
switching,  message  switching  and  packet  switching  (Kleinrock  1976) . 

A  circuit-switching  network  provides  service  by  setting  up  the 
complete  path  of  connected  channels  from  the  source  to  the 
destination.  After  the  path  is  established,  a  return  signal  informs 
the  source  that  data  transmission  may  proceed  and  all  channels  are 
used  simultaneously.  When  the  message  has  been  transmitted  over  the 
path,  the  source  node  releases  the  circuit  and  the  channels  become 
available  for  use  by  other  paths. 
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In  a  message-switching  communications  network,  only  one  channel 
is  used  at  a  time  for  a  given  transmission.  The  message  first 
travels  from  its  source  node  to  the  next  node  in  its  path  and  when 
the  entire  message  is  received  at  the  node  then  the  next  step  in  its 
journey  is  selected.  If  this  selected  channel  is  busy,  the  message 
waits  in  a  queue  and  when  the  channel  becomes  free,  transmission  of 
the  message  continues. 

Packet  switching  is  similar  to  message  switching  except  that  the 
messages  are  divided  into  smaller  pieces  called  packets  that  have  a 
maximum  length.  The  packets  are  numbered  and  addressed  and  travel 
through  the  net  in  a  packet-switched  (store  and  forward)  manner. 

Many  packets  of  the  same  message  may  be  in  transmission  simulta¬ 
neously,  thereby  reducing  the  transmision  delay. 

The  communication  networks  examined  in  this  paper  are  classified 
as  message-switching  networks. 

Regarding  the  composition  of  a  communication  network,  Kleinrock 
(1976)  relates  that  it  is  made  up  of  (1)  the  physical  network, 
consisting  of  the  switching  computers  and  the  communication  channels; 
(2)  the  flow  consisting  of  messages  (described  by  their  origin, 
destination,  origination  time,  length,  and  priority  class)  that  move 
through  the  network  in  a  store  and  forward  fashion;  and  (3)  the  set 
of  operating  rules  for  handling  the  flow  of  this  message  traffic. 
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A  number  of  design  variables  are  involved  in  the  synthesis  of 
these  networks  including  the  message  routing  procedure,  the  flow 
control  procedure,  the  channel  capacity  assignment,  the  priority 
queueing  discipline  and  the  topological  configuration.  A  fixed 
routing  procedure  is  defined  as  one  in  which  a  message’s  path  through 
the  network  is  uniquely  determined  from  only  its  origin  and  destina¬ 
tion.  When  more  than  one  path  is  possible,  the  procedure  is  called 
an  alternate  routing  procedure.  If  a  routing  algorithm  bases  its 
decisions  on  some  measure  of  the  observed  traffic  flow,  it  is  called 
a  dynamic  or  adaptive  routing  procedure. 

The  networks  investigated  in  this  paper  contain  the  fixed  routing 
procedure  which  is  established  during  the  design  of  each  network. 

The  task  of  controlling  the  amount  of  traffic  permitted  to  enter 
the  network  is  handled  by  the  flow  control  procedure.  The  procedure 
prevents  congestion  by  regulating  the  entry  of  trafffic  from  the 
processing  elements  to  the  communication  interface  elements  and 
network  channels.  Local  flow  control  which  occurs  at  each  node  is  a 
result  of  the  limited  buffer  space  available.  Whenever  this  buffer 
space  is  used  up,  a  node  has  to  stop  further  output  to  the  network 
channels.  Thus,  messages  may  experience  an  admission  delay  which 
contributes  to  the  total  delay  similar  to  the  queuing  delay  in  the 
output  queues. 
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Another  type  of  control  is  called  global  flow  control,  which  is 
designed  to  stop  further  input  to  the  communication  network  before 
all  the  buffer  space  in  the  net  is  occupied.  The  flow  procedure  is 
intended  to  prevent  a  lockup  in  the  network. 

The  processing  capacity  in  each  node  has  a  direct  effect  on  the 
input  of  messages  to  the  communication  net.  The  processor  and 
resident  software  must  be  capable  of  generating  the  messages  at  a 
rate  consistent  with  the  network  requirements.  If  the  node  has  an 

insufficient  capacity,  then  the  traffic  entering  the  network,  y.. 

3* 

where  j  is  the  source  node  and  k  is  the  destination  node,  in  messages 
per  second  would  not  meet  the  system  requirements.  An  over-proces¬ 
sing  capability  at  the  node,  while  meeting  the  system  requirements, 
would  not  be  a  cost-effective  design.  Thus,  the  processor  and 
software  design  for  each  node  must  be  consistent  with  the  require¬ 
ments  at  the  particular  node. 

The  topological  configuration  of  the  communication  network  has  a 
significant  effect  on  the  network  behavior  as  will  be  shown  later  in 
this  paper.  Considerations  such  as  network  reliability  are  used  in 
determining  the  appropriate  topology.  The  queuing  discipline  that 
governs  the  order  of  service  for  the  many  channel  queues  must  also  be 
determined. 

After  the  topology  is  chosen  a  capacity  assignment  must  be  made 
to  each  channel.  Schwartz  (1977)  states  that  the  network  requires  the 
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best  allocation  of  capacity,  link  by  link,  in  the  sense  of  minimizing 
average  message  time  delay.  Capacity  assignments  are  dependent  upon 
the  routing  strategies  adopted.  Three  capacity  assignment  strategies 
are  examined  in  this  paper: 

1.  An  equal  assignment  strategy  in  which  the  total  capacity  C 
is  simply  divided  equally  among  all  the  links. 

2.  A  proportional  assignment  strategy  in  which  C^,  the 
capacity  assigned  to  link  i,  is  proportional  to  the  traffic  uei^and. 


3.  An  optimum  capacity  assignment  strategy  in  the  sense  of 
minimizing  the  average  time  delay  throughout  the  network.  This  is 
also  called  the  square  root  assignment  strategy  as  has  a  term 
proportional  to  X^. 

Once  a  message  enters  the  network,  it  will  eventually  be  trans¬ 
mitted  over  a  channel;  however,  if  the  channel  is  in  use  when  the 
message  requires  this  service,  then  the  message  must  join  a  queue  and 
wait.  The  service  or  transmission  time  for  a  given  message  is  the 
message  length  (in  bits)  divided  by  the  capacity  of  the  channel  (in 
bits  per  second).  This  procedure  occurs  at  each  channel  until  the 
message  reaches  its  destination.  The  total  time  spent  in  the  network 
is  referred  to  as  message  delay  (or  network  delay). 
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in  this  paper  several  network  topologies  which  are  considered  as 
candidates  for  a  distributed  real-time  computing  system  are  examined. 

A  functional  system  is  partitioned  into  several  nodes  and  the  network 
traffic  requirements  compiled  for  selected  network  topologies. 
Processing  requirements  for  each  node  are  determined  based  on  the 
software  functional  performance  necessary. 

The  average  delay  time  of  messages  transmitted  in  a  network  is 
of  prime  interest  in  the  selection  of  a  processor  network  topology 
and  bandwidth  capacity  for  the  channels.  Message  delay  times  for 
each  network  link  (or  channel)  are  determined  by  analytical  methods 
for  each  topology  considered.  This  information  is  used  in  determining 
a  network  topology  which  provides  the  minimum  message  delay  for  the 
application  under  study. 

A  simulation  of  the  entire  network  is  developed  in  order  to 
introduce  processor  delays  as  these  delays  are  not  included  in 
existing  network  analytical  methods.  The  objective  of  the  simulation 
experiments  is  to  arrive  at  a  system  design  which  is  consistent  with 
the  functional  software  requirements. 

The  methodology  developed  in  this  paper  permits  the  determina¬ 
tion  of  software  requirements,  in  terms  of  the  number  of  instructions 
executed,  to  be  accomplished  as  an  initial  step  in  the  system  design 
process.  The  desired  system  response  time  is  then  established  and 
software  and  hardware  specifications  may  then  be  defined.  A  case 
study  serves  to  illustrate  the  methodology. 
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2.0  NETWORK  TOPOLOGIES 


An  examination  of  computer  communication  networks  reveals  there 
are  several  alternatives  for  a  distributed  computing  system.  Included 
in  this  grouping  and  identified  by  the  topological  characteristics 
are  the  ring  (or  loop),  interconnection,  global  bus  and  star  networks. 

The  features  of  a  network  that  distinguish  its  architecture 
include  its  topology,  node  composition,  size  and  network  control 
techniques.  Andersen  and  Jensen  (1975)  have  provided  a  comprehensive 
taxonomy  for  systems  of  interconnected  computers  and  those  topologies 
considered  as  candiates  for  the  system  under  study  will  be  addressed. 

In  the  star  topology,  communications  from  one  node  to  another 
always  pass  through  the  "hub  node"  which  may  be  a  computer  or  other 
switching  mechanism.  The  interconnected  topology  may  have  nodes 
connected  to  one  another  to  the  point  where  each  node  is  connected  to 
every  other  node.  In  a  ring  topology  every  node  is  connected  to  two 
other  nodes  of  the  network.  The  global  bus  network  has  each  node 
interconnected  by  a  common  bus. 

Network  composition  may  be  considered  either  homogeneous  or 
heterogeneous  depending  upon  the  similarity  of  the  switching  nodes 
and  attached  processors. 
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The  size  of  a  network  is  usually  determined  by  the  number  of 
nodes  or  processors  associated  with  the  system. 

Network  control  functions  include  establishing  the  initial 
connection,  flow  control,  routing,  monitoring  and  measurement.  The 
initial  connection  can  be  centralized  at  one  processing  element  in 
the  network  or  by  allowing  the  interfaces  to  the  network  of  the 
involved  processes  to  be  responsible.  The  traffic  flow  control 
between  switching  nodes  will  usually  be  controlled  by  ordinary  line 
procedures.  Routing  must  be  handled  by  communications  software  if 
the  message  can  traverse  more  than  one  path  in  the  network. 

Monitoring  and  measurement  of  the  network  performance  can  be 
accomplished  by  hardware  and  software  distributed  in  the  computer 
communications  network.  Network  configurations  have  attributes  which 
make  them  satisfactory  for  one  application  and  less  desirable  for 
another.  Characteristics  which  aid  in  this  determination  include 
speed,  fault  tolerance,  flexibility  and  ease  of  use.  The  significant 
factors  of  each  of  the  network  topologies  are  discussed  in  the 
following  paragraphs. 

2.1  RING  NETWORK 

Ring  architectures  as  shown  in  Figures  2-1  consist  of  a  number 
of  individual  processing  elements  (PEs),  with  each  element  connected 
to  two  neighboring  elements.  Hereafter,  processing  elements  are 
referred  to  as  PE's.  The  traffic  flow  in  a  loop  could,  in  principle, 
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Hgura  2-1.  Ring  Network  Topology 


Figure  2-2.  Complete  Interconnection  Network  Topology 


Figure  2-3.  Partial  Interconnection  Network  Topology 


be  in  both  directions;  however,  the  complexity  of  bidirectional 
traffic  has  made  it  necessary  to  have  only  unidirectional  traffic. 

In  a  ring  network,  one  neighboring  element  of  a  PE  may  be  regarded  as 
a  source  neighbor  and  another  regarded  as  a  destination  neighbor. 
Messages  circulate  around  a  ring  from  source  PE  to  destination  PE 
with  intermediate  PEs  acting  as  relay  or  buffer  units.  Ring  networks 
allow  one  or  more  messages  to  circulate  simultaneously  and  the 
messages  may  be  of  fixed  or  variable  length. 

The  ring  architecture  accepts  change  easily  as  an  additional  PE 
may  be  inserted  in  the  ring  with  the  addition  of  a  single  communica¬ 
tion  path  and  the  traffic  flow  is  usually  not  altered  significantly 
by  an  addition  or  deletion.  The  failure-effect  and  failure-configura¬ 
tion  characteristics  of  ring  networks  are  poor  since  a  single  failure 
in  a  path  or  a  PE  interface  causes  a  break  in  the  ring.  In  order  to 
mask  the  fault,  a  fully- redundant  ring  path  is  required  along  with  a 
bypass  switching  capability  in  the  PE  interfaces.  A  second  failure 
can  be  catastrophic  and  cause  isolation  of  certain  nodes. 

The  logical  complexity  of  communications  in  a  ring  network  is 
low  as  a  PE  must  only  relay  messages,  originate  messages  and  transmit 
them  to  a  single  or  multiple  destinations,  recognize  messages  destined 
for  itself,  and  "strip"  off  messages  when  required.  The  bandwidth  of 
the  single  loop  is  a  potential  bottleneck  as  communication  rates 
increase. 
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Most  ring  networks  implemented  have  used  the  bit-serial  data 
links  as  communication  paths  between  PEs.  This,  along  with  delays 
associated  in  relaying  messages,  has  resulted  in  significant 
increases  in  message  transit  times  around  the  ring.  This  network  is 
usually  implemented  where  reliability  and  performance  requirements 
are  not  stringent. 

The  Distributed  Computer  System  (DCS),  at  the  University  of 
California,  Irvine,  is  the  best-known  example  of  a  ring  network 
(Farber  1973) .  The  DCS  consists  of  five  minicomputers  and  a  number 
of  peripheral  devices  located  around  the  campus.  The  loop  is 
bit-serial  and  operates  at  a  data  rate  of  2.3  megabits/second. 
Variable-length  messages  can  circulate  simultaneously.  Fault 
tolerance  is  provided  by  a  redundant  loop  and  bypass  switches. 
Messages  are  sent  to  a  logical  process  rather  than  to  a  physical 
processor.  The  ring  interface  recognizes  the  address  and  accepts  the 
message,  thus  allowing  communication  to  be  independent  of  the  number 
of  processors  and  process/processor  assignments. 


2.2  INTERCONNECTION  NETWORK 


The  complete  interconnection  network  shown  in  Figure  2-2  is 
perhaps  the  simplest  design  type  in  the  taxonomy.  Each  processor  is 
connected  to  every  other  processor  in  the  system  by  a  dedicated  path 
or  link  and  messages  between  processors  are  transferred  only  on  the 
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path  connecting  them.  The  source  processor  must  select  the  path  to 
the  destination  processor  from  among  the  several  paths  available,  and 
all  processors  must  be  capable  of  handling  incoming  messages  from 
many  paths. 

The  addition  of  the  nth  processor  to  a  complete  interconnection 
network  requires  the  addition  of  n-1  paths  between  it  and  the  other 
processors.  Also,  the  processors  must  have  facilities  for  accepting 
the  new  PE  as  a  data  source.  Thus,  the  interfaces  must  have  a 
minimum  of  M-l  parts,  where  M  is  the  maximum  size  of  the  system. 

This  all  contributes  to  a  poor  cost-modularity  for  this  network 
topology . 

Failure  of  a  path  or  processor  is  handled  easily  in  an  intercon¬ 
nection  network  as  the  failed  components  can  be  disconnected  from  the 
system.  This  architecture  forces  a  location  addressing  policy  to 
reduce  the  total  network  traffic  low.  Logical  processor  addressing 
would  have  the  messages  traveling  on  too  many  links. 

The  partial  interconnection  network  topology  differs  from  the 
complete  interconnection  network  topology  in  that  at  least  one 
processor  is  not  connected  to  every  other  processor  in  the  system. 

This  one  processor,  however,  must  be  connected  to  at  least  two  other 
processors.  This  topology  is  shown  in  Figure  2-3. 

Interconnection  networks  have  the  advantage  that  they  may  be 
geographically  either  localized  or  dispersed. 
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2.3  GLOBAL  BUS  NETWORK 


The  global  bus  architecture  illustrated  in  Figure  2-4  consists 
of  a  number  of  processing  elements  interconnected  by  a  common  or 
global  bus.  Access  to  the  bus  is  determined  by  an  allocation  scheme 
with  messages  sent  from  the  source  PE  onto  the  bus.  Messages  are 
recognized  and  accepted  by  the  appropriate  PE  interface  as  in  logical 
processor  addressing. 

Additional  PEs  may  be  added  to  the  system  with  little  impact  on 
the  remainder  of  the  system.  In  order  to  increase  performance  it  is 
usually  necessary  to  replicate  the  bus  or  to  change  the  implementa¬ 
tion  of  the  entire  bus,  options  which  have  a  significant  impact  on 
the  design  of  the  bus  interfaces  of  the  system. 

A  failed  processing  element  or  processor  interface  requires  no 
hardware  reconfiguration  to  continue  system  operation.  Failures  of 
the  bus,  however,  are  catastrophic  and  replication  is  required  for 
continued  operation  after  a  bus  failure.  The  fixed  bandwidth  of  the 
bus  poses  potential  problems  as  the  data  rates  are  increased. 


2.4  STAR  NETWORK 

The  star  network  topology  is  comprised  of  a  central  switching 
element  to  which  a  number  of  processors  are  connected,  each  by  a 
single  bidirectional  link.  The  central  switch  is  the  apparent 
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destination  and  source  for  all  messages.  This  network  topology  is 
shown  in  Figure  2-5. 

A  failure  of  a  processor  element,  processor  interface,  or  path 
requires  no  hardware  reconfiguration  of  the  system.  The  failure  of 
the  switch  is  catastrophic,  however.  Message  traffic  at  the  switch 
can  be  a  problem  with  this  design.  The  switch  must  be  able  to 
accommodate  additional  PEs  as  each  processor  must  have  its  own  path 
to  the  central  switch. 

Adequate  information  in  the  form  of  routing  tables  must  be 
provided  within  the  switching  resource  to  permit  communications  to 
occur. 
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3.0  FUNCTIONAL  PARTITIONING 


A  real-time  system  was  selected  for  evaluation  of  performance 
when  operating  under  different  network  configurations.  The  objective 
was  to  compare  the  performance  based  on  average  message  delay  times 
associated  with  each  network  topology.  The  network  topologies 
examined  in  this  study  are  partial  interconnection,  ring  and  global 
bus  and  are  shown  in  Figures  3.1  through  3.3.  The  complete  inter¬ 
connection  network  topology  contained  more  links  than  necessary  for 
this  application  and  was  not  studied  further.  The  star  network 
topology  was  eliminated  from  the  candidate  set  of  architectures  due 
to  its  central  point  of  failure  at  the  switch. 

The  computer  software  of  the  system  chosen  for  the  evaluation 
currently  resides  in  a  centralized  computer  system.  The  software 
program  is  comprised  of  an  executive  program,  several  functional 
modules  and  a  global  data  base.  The  existing  system  was  examined  to 
determine  if  partitioning  could  be  accomplished  in  a  logical  manner. 

The  fact  that  it  was  designed  in  a  modular  fashion  enabled  the 
system  to  be  partitioned  in  a  straight-forward  manner.  Experience 
has  shown  that  a  typical  design  for  the  system  would  include  four  (4) 
interactive  display  consoles,  a  large  screen  display,  a  horizontal 
plotter,  a  data  base  controller,  an  input  data  processor  and  a 
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communications  controller.  Thus,  a  design  was  chosen  with  nine  (9) 
nodes  in  the  system.  Including  an  embedded  processor  in  each  node 
was  intended  to  minimize  the  response  time  and  also  keep  the  network 
message  traffic  as  low  as  possible. 

A  system  configuration  was  postulated  to  exercise  the  network  in 
a  realistic  manner.  Functions  were  allocated  to  the  nodes  as  follows: 


Node  1 
Node  2 
Node  3 
Node  4 
Node  5 
Node  6 
Node  7 
Node  8 
Node  9 


-  Input  Data  Processor 

-  Object  Motion  Computations 

-  Data  Base  Controller 

-  Time  Bearing  Presentation 

-  Communications  Controller 

-  Operations  Sumnary 

-  Vehicle  Computations 

-  Geographic  Situation  Presentation 

-  Object  Motion  Computations 


Nodes  1,  3,  5  and  7  are  fixed- function  nodes  while  the  functions  in 
the  remaining  nodes  are  operator  selectable. 


A  determination  was  made  regarding  the  accesses  to  the  global 
data  base  by  software  modules  resident  in  each  node.  Portions  of  the 
global  data  base  at  the  Data  Base  Controller  node  were  replicated  at 
the  other  nodes.  Next,  each  node  was  examined  to  determine  Che  data 
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field  updates  necessary  for  each  data  table  resident  at  the  node  and 
a  message  traffic  flow  matrix  developed  as  shown  in  Table  A-l.  The 
node  data  field  traffic  requirements  are  given  in  Table  A-2. 

A  data  table  traffic  matrix  was  constructed  to  illustrate  the 
amount  of  16-  and  32-bit  traffic  in  bits  per  second  required  from 
source  to  destination  nodes  as  shown  in  Table  A-3.  Also  determined 
was  the  data  field  traffic  requirements  in  fields  per  second  at  each 
node  as  shown  in  Table  A-4. 

3.1  INTERCONNECTION  NETWORK 


The  interconnection  network  design  originated  with  a  complete 
interconnection  network.  Links  with  low  message  traffic  were  removed 
from  the  network  where  traffic  could  be  routed  on  other  links  without 
causing  excessive  loading.  For  study  purposes,  however,  links  6  and  8 
are  relatively  lightly  loaded  while  link  7  is  heavily  loaded. 

Message  routing  in  the  interconnection  topology  network,  which 
was  determined  in  the  design  process,  is  shown  in  Table  A-8.  Three 
message  lengths  are  defined  for  purposes  of  this  study  in  network 
performance  evaluation  and  are  as  follows: 

Short  Message:  16  32-bit  words  *  512  bits 
Medium  Message:  32  32-bit  words  =  1024  bits 
Long  Message:  64  32-bit  words  *  2048  bits 
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The  number  of  data  bits  per  second  is  shown  in  Table  A-3.  From 
this,  the  number  of  short,  medium  and  long  messages/second  from  a 
source  node  to  a  destination  node  is  computed  as: 


Short : 


Medium: 


34736  bits/second 
512  bits/message 

34736  bits/second 
1024  bits/message 

34736  bits/second 


67.84  short  messages/second 


33.92  medium  messages /second 


Long:  r  — — — — -  =16.96  long  messages /second 

2048  bits/message  ° 

The  complete  presentation  of  short,  medium  and  long  messages  per 

second  from  source  to  destination  nodes  and  the  associated  link 

traffic  is  shown  in  Tables  A-5  through  A-7  and  A-9  through  A-ll.  This 

results  in  a  value  for  link  loading  in  messages  per  second,  A^, 

where  i  identifies  the  particular  link.  Message  arrivals  are  assumed 

to  be  Poisson  in  this  study. 


The  total  message  traffic  through  each  of  the  links  is 

,  Z. 

A  =  .X. 

i  i 

and  the  value  for  short  messages  is 

A  *  1679  messages/ second . 

Similarly,  values  for  medium  and  long  messages  are  found  to  be  871 
and  464  messages/ second  respectively. 


3.2  RING  NETWORK 


The  ring  network  message  routing  is  unidirectional  and  is  shown 
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in  Table  A- 12.  Message  lengths  are  identical  to  the  interconnected 
network  messages. 

Link  traffic  for  the  short,  medium,  and  long  messages  is  shown 
in  Tables  A-13,  A-14  and  A-15. 

The  total  average  message  traffic  through  each  of  the  links  is 


and  the  value  for  short  messages  is 

A  *  5630  messages/second. 

Also,  the  values  for  medium  and  long  messages  are  3903  messages/second 
and  1710  messages/second  respectively. 

In  order  to  utilize  more  effectively  the  ring  network  features, 
a  revised  traffic  matrix  was  developed  under  the  premise  that  data 
would  be  sent  to  the  most  distant  destination  node  only.  Messages 
required  by  intermediate  nodes  also  would  be  recognized  by  the 
processing  element  interface  and  a  copy  forwarded  to  the  processing 
element.  Thus,  replicated  messages  would  not  be  sent  from  a  source 
node  and  network  traffic  could  be  reduced. 

Traffic  matrices  for  the  revised  loading  scheme  are  shown  in 
Tables  A-16  through  A-20.  Link  loading  is  given  in  Tables  A-21,  A-22 
and  A-23. 
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The  total  average  message  traffic  through  each  of  the  links  with 


the  revised  data  for  short  messages  is 

X  =  2840  mess ages/ second. 

Also,  values  of  1453  messages/second  and  763  messages/second  are 
obtained  for  the  medium  and  long  messages  respectively. 


3.3  GLOBAL  BUS  NETWORK 


Message  routing  for  the  global  bus  network  is  shown  in  Table 
A-24.  As  there  is  only  one  link  in  this  network,  all  message  traffic 
is  on  link  1. 

Link  traffic  in  messages  per  second  for  the  short,  medium  and 
long  messages  is  shown  in  Table  A- 25. 

Note  that  the  total  average  message  traffic  through  the  link  is 
identical  to  that  for  the  ring  network.  Short  messages  have  a  value 
of  5630  messages/second;  medium  messages,  2903  messages/second;  and 
long  messages,  1710  messages/second. 

A  revised  traffic  matrix  was  also  developed  for  the  global  bus 
network  to  utilize  the  features  which  could  reduce  traffic  flow.  The 
link  traffic  values  in  messages/second  are  again  identical  to  the 
ring  network  and  are  519,  265  and  141  in  the  short,  medium  and  long 
messages  respectively  as  shown  in  Table  A-26. 
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4.0  NETWORK  ANALYSIS 


The  three  network  topologies,  which  are  interconnection,  ring, 
and  global  bus,  were  analyzed  while  varying  certain  parameters  in  the 
system.  These  parameters  are  the  network  bandwidth,  the  message 
length  and  the  network  link  capacity  allocation  strategy. 

An  objective  of  the  analysis  was  to  determine  the  average 
message  delay  for  each  combination  of  network  variables. 

4.1  NETWORK  BANDWITH 

Three  network  bandwidth  values  were  defined  for  a  gross  examina¬ 
tion  of  the  system  requirements.  The  bandwidths  are  5  megabit,  10 
megabit,  and  20  megabit  networks.  These  values  are  well  within  the 
state-of-the-art  and  are  typical  for  real-time  systems  similar  to  the 
one  being  examined.  In  order  to  provide  a  further  refinement  of  the 
requirements,  bandwidths  values  of  1,  2,  3  and  4  megabits/second  were 
studied. 

4.2  MESSAGE  LENGTH 

In  addition  to  message  data,  each  message  has  appended  to  it  4 
16-bit  words  of  overhead  to  provide  message  length,  source,  destina¬ 
tion  and  time  information. 
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The  average  message  length,  1/y^  in  bits,  is  computed  as: 

Short  Message:  512  bits/message  +  64  bits  overhead  =  576  bits 
Medium  Message:  1024  bits/message  +  64  bits  overhead  =  1088  bits 
Long  Message:  2048  bits/message  +  64  bits  overhead  =  2112  bits. 

The  number  of  data  bits/second  on  a  link  is  determined  as  follows: 

2171  data  fields/second  X  16  bits/data  field  =»  34736  bits/second. 

4.3  CAPACITY  ALLOCATION  STRATEGY 


The  equal  assignment  strategy,  proportional  assignment  strategy, 
and  optimum  capacity  assignment  strategy  were  utilized  in  the  network 
analysis  (Schwart2  1977) . 

4.3.1  EQUAL  CAPACITY  ASSIGNMENT  STRATEGY 

An  equal  assignment  strategy  is  one  in  which  the  total  capacity 
C  is  simply  divided  equally  among  all  the  links,  independent  of  the 
traffic  on  the  link.  In  the  case  where  the  total  capacity  is  5 
megabits/second  and  there  are  9  links 

C^  *  555,556  bits/second. 

4.3.2  PROPORTIONAL  CAPACITY  ASSIGNMENT  STRATEGY 


A  proportional  assignment  strategy  in  which  C  is  proportional  to 
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the  traffic  demand  has 

C. 

1 


prop 


CXi 

X 


Link  1  of  the  ring  network  had 


|  prop  3.  929,840  bits/second. 


4.3.3  OPTIMUM  CAPACITY  ASSIGNMENT  STRATEGY 


The  optimum  capacity  assignment  is  intended  to  minimize  the 
average  time  delay  throughout  the  network  and  is  given  as  (Schwartz 
1977) 

X  C(l-p)VxT7u7 

ci|opl:~ir*  ZvA'/m;-'  • 

Link  traffic  demand  X^  and  the  average  message  length 
1/y^  are  given  for  a  typical  case.  C  is  the  overall  capacity  of 
the  network  and  is  fixed.  The  network  traffic  intensity  factor,  p, 
is  found  by 

P  =*  X/yC 

Note  that  the  form  of  the  optimum  capacity  expression  has  two 
parts.  The  first,  X^/y^,  represents  the  absolute  minimum 
capacity  assignment  that  must  be  allocated  to  link  i  to  enable  the 
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traffic  over  that  link  to  be  transmitted.  The  second  part  then 

* 

allocates  the  remaining  capacity  to  each  link  following  a  square-root 
assignment  strategy.  An  example  is  given  in  Appendix  B  for  the 
interconnection  network  using  short  messages. 


The  traffic  intensity  parameter  for  the  interconnection  networks  is 


p  =*  ~  -  0.1934 

pC 


4.4  DELAY  ANALYSIS 


The  objective  now  is  to  solve  for  T,  the  average  message  delay 
in  an  M-channel,  N-node  model.  It  is  assumed  that  there  is  a  fixed 
routing  procedure  for  the  message  traffic  in  each  of  the  networks 
examined  (Kleinrock  1976). 

The  path  taken  by  messages  that  originate  at  node  j  and  that  are 
destinated  for  node  k  is  denoted  by  tt ^ .  Also,  the  ith  channel 
with  capacity  is  included  in  the  path  ir^  if  that  channel  is 
traversed  by  messages  using  this  path.  Thus,  it  can  be  said  that  the 
average  rate  of  message  flow,  X^,  on  the  ith  channel  is  equal  to 
the  sum  of  the  average  message  flow  rates  of  all  paths  that  use  this 
channel  that  is 

E  E 

i  "  j  k  Y  jk 

j,k  :C.  c  wjk 
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Next  a  solution  is  found  for  a  message's  average  system  time  in 
a  single  channel  that  is  deeply  embedded  within  a  communications 
network.  Jackson  (1957),  in  studying  network  problems,  established 
the  result  that  this  embedded  channel  offered  a  solution  identical  to 
that  of  the  same  channel  acting  independently  from  the  network  but 
with  Poisson  arrivals  at  a  rate  equal  to  that  offered  by  the  networks. 
However,  in  our  model  there  is  a  dependence  among  the  interarrival 
and  service  times.  Kleinrock  (1976)  concludes  that  we  want  this 
dependence  to  disappear  and  in  fact  this  dependence  can  be  reduced  to 
the  point  where  we  have  approximate  independence.  This  is  based  on 
the  assumption  that  messages  leaving  the  node  on  a  given  channel  had 
entered  the  node  from  distinct  channels  or  messages  entering  on  the 
same  channel  depart  on  distinct  channels.  The  independence 
assumption  states  that  each  time  a  message  is  received  at  a  node 
within  the  network,  a  new  message  length  is  chosen  from  the 
exponential  distribution.  We  know  this  is  not  true  as  a  message 
maintains  its  length  as  it  passes  through  the  network,  but  the  effect 
of  the  assumption  on  the  performance  measure  T  has  been  shown  to  be 
negligible  in  most  networks. 

Utilizing  the  isolated  channel  concept,  the  ith  channel  is 
represented  as  an  M/M/1  system  with  Poisson  arrivals  at  a  rate 
and  exponential  service  times  of  mean  1/yC^  seconds.  The 
solution  for  T^  is  given  as 
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This  assumes  Poisson  message  arrivals,  exponentially  distributed 
message  lengths,  and  an  infinite  buffer  for  the  queue.  It  is  assumed 
that  all  messages  in  the  network  have  the  same  average  length, 

1/y.  This  delay  includes  the  time  taken  to  transmit  an  average 
message  plus  the  message  buffering  delay  (Schwartz  1977) . 


From  (4-3)  and  (4-4)  the  following  is  obtained 


M 

T  =  E 
i=l 


li 

Y 


(4-5) 


An  illustrative  example  which  results  in  a  solution  for  the 
average  message  delay  is  given  in  Appendix  B.l. 


4.4.1  PROGRAM  NETWORK 


A  FORTRAN  program  was  developed  to  aid  in  the  analysis  of 
network  topologies.  Program  Network  computes  the  average  message 
delay  for  message  traffic  between  nodes  in  a  nine-node  network.  The 
network  topologies  examined  in  the  program  are  ring,  partial 
interconnection  and  global  bus. 

Capacity  allocation  strategies  included  in  the  program  are  equal 
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assignment,  proportional  assignment  and  optimum  assignment. 


The  program  provides  £or  the  insertion  of  three  network  bandwidth 
capacities  and  three  message  average  lengths  for  evaluation  purposes. 

In  addition  to  providing  the  average  message  delay  time  for  each 
combination  of  parameter  values,  the  bandwidth  capacity  and  average 
delay  time  which  messages  encounter  on  each  link  of  the  network  are 
given. 


4.4.2  ANALYSIS  RESULTS 


Equations  for  analysis  of  the  three  network  configurations  are 
included  in  Program  Network  and  runs  were  conducted  varying  each  of 
the  parameters.  Short,  medium  and  long  message  lengths  were  used  as 
were  1-,  2-,  3-,  4-,  5-,  10- ,  and  20-  megabit  bandwidths  for  the 
network.  Another  variable  in  the  parametric  study  is  the  capacity 
assignment  strategy  where  the  equal,  proportional  and  optimum 
capacity  assignment  strategies  were  utilized. 

Average  message  delay  data  are  shown  in  tables  C-l  through  C-9. 
Data  are  presented  for  five  network  cases  -  interconnection,  ring, 
global  bus,  ring  (with  revised  message  traffic)  and  global  bus  (with 
revised  message  traffic).  Average  message  delay  time  vs.  message 
size  and  assignment  strategy  is  shown  for  each  network  bandwidth. 
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The  global  bus  network  provides  the  lowest  average  message  delay 
for  all  cases  as  shown  in  Tables  C-l  through  C-3  and  is  the  only 
topology  satisfactory  at  the  1-megabit  bandwidth  capacity  level  for 
the  equal  capacity  assignment  strategy.  As  can  be  seen  in  these 
figures,  the  4-megabit  network  provides  a  sufficiently  high  traffic 
capacity  for  the  application  so  that  all  network  topologies  perform 
satisfactorily  for  short  and  medium  messages,  i.e.  less  than  25  milli¬ 
seconds  delay. 

The  average  message  delays  for  the  proportional  capacity  assign¬ 
ment  strategy  with  short,  medium  and  long  messages  are  given  in 
Figures  C-4  through  C-6.  While  not  performing  as  well  as  the  global 
bus  discussed  earlier,  the  ring  (with  modified  data)  and  the  intercon¬ 
nection  topologies  perform  well  at  the  4  megabit  capacity  for  all 
message  lengths. 

An  optimum  capacity  assignment  strategy  improved  the  ring 
(modified  data)  and  interconnection  network  topologies  with  both 
performing  well  at  the  2-megabit  capacity  for  short  messages.  This 
is  illustrated  in  Table  C-7. 

An  examination  of  the  data  reveals  that  the  lightly  loaded 
traffic  links  receive  less  capacity  than  do  the  heavily  loaded 
traffic  links  in  the  proportional  and  optimum  capacity  assignment 
strategies.  Links  6  and  7  illustrate  this  situation. 
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The  proportional  capacity  allocation  strategy  provides  a  capacity 
of  23823.70  bits/second  for  link  6  with  an  8  messages/second  loading. 
This  results  in  an  average  delay  over  the  link  of  30  milliseconds. 

Link  7  is  given  a  capacity  of  1060154  bits/second  for  a  loading  of 
356  messages/ second  resulting  in  an  average  message  delay  of  0.67 
milliseconds.  These  data  are  for  short  message  lengths. 

The  optimum  capacity  allocation  strategy  reduces  the  spread  in 
message  delay  times  between  the  lightly  and  heavily  loaded  links. 

Link  6  has  a  capacity  of  72373  bits/second  and  an  average  message 
delay  of  8.5  milliseconds.  Link  7  is  allocated  a  capacity  of  657109 
bits/second  and  results  in  an  average  message  delay  of  1.3  milli¬ 
seconds  . 

Thus,  the  light  user  is  penalized  in  favor  of  the  heavy  user  in 
order  to  minimize  the  average  time  delay. 
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5.0  NETWORK  SIMULATION 


A  GPSS  simulation  was  developed  for  the  nine-node  distributed 
computing  system  with  the  global  bus  network  topology.  Each  node  (or 
processing  element)  operates  in  a  round-robin  fashion.  Node 
processing  times  are  input  as  initial  values  and  the  channel  delay 
time  is  based  on  the  particular  bandwidth  being  considered. 

The  simulation,  which  runs  under  General  Purpose  Simulation 
System/360,  is  utilized  in  a  parametric  study  of  the  network  message 
delay  times  including  the  processor  and  channel  components. 

5.1  SIMULATION  RUNS 


Several  simulation  experiments  were  conducted  to  examine  the 
total  message  delay  (or  transit)  time  in  the  network.  The  parameters 
in  the  program  are  (1)  processing  times  for  each  of  the  nine  nodes, 
(2)  the  message  arrival  rates  and  (3)  the  channel  delay  times. 

The  processing  time  parameter  is  determined  by  dividing  the 
number  of  instructions  executed  per  cycle  as  shown  in  Table  D-l  by 
the  processing  capability.  Values  of  0.2,  0.4  and  0.6  million 
instructions  per  second  (MIPS)  are  utilized  for  the  study.  The  node 
processing  times  are  given  in  Table  D-2. 
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The  message  arrival  rate  is  varied  to  provide  times  of  50,  100 
and  200  milliseconds  to  determine  the  effect  of  this  parameter  on 
message  delay  times. 

Channel  delay  times  for  the  global  bus  topology  with  network 
bandwidths  of  1,  2,  3  and  4  megabits  per  second  are  utilized  in  the 
exper iment . 

The  simulation  model  provides  for  two-node,  three-node  and  four- 
node  serial  communication  paths  with  the  global  bus  handling  the 
node-to-node  message  traffic.  The  two-node  communication  paths  can 
have  any  node  transmitting  to  another  node.  The  three- node  ccmmunica- 
tion  path  includes  nodes  1,  9  and  6  in  that  order,  while  the  four-node 
path  includes  nodes  1,  2,  7  and  5.  Data  are  tabulated  during  each 
transmission  and  an  overall  message  delay  is  computed  for  all 
transactions  in  the  model. 

5.2  TEST  OBJECTIVE 


Experimental  runs  were  conducted  to  determine  a  combination  of 
global  bus  bandwidth,  message  arrival  rate  and  node  processing 
capability  which  would  meet  the  overall  message  delay  time  objective 
of  200  milliseconds  and  four-node  processing  time  of  300  milliseconds. 
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5.3  SIMULATION  RESULTS 


Several  runs  were  conducted  for  the  combination  of  parameters 
mentioned  earlier.  An  examination  of  the  tabulated  message  delay 
data  provided  a  relative  performance  standing  for  each  test  case  as 
shown  in  Table  5-1.  The  relative  performance  was  based  on  the 
threshold  message  delays  of  250  milliseconds  for  the  overall  average 
delay  and  350  milliseconds  for  the  four-node  message  delay.  Data  for 
the  two-  and  three-node  cases  were  expected  to  fall  between  these  two 
values.  Detailed  results  are  presented  in  Table  D-3  and  in  Figures 
D-l  through  D-3. 

It  is  interesting  that  with  a  50-millisecond  message  arrival 
rate,  the  message  delay  is  unaffected  by  network  bandwidths.  The  100- 
millisecond  message  arrival  rate  indicates  a  slight  decrease  in 
overall  message  delay  as  the  bandwidth  increases?  whereas  at  the  200- 
millisecond  rate,  there  is  a  pronounced  decrease  in  overall  message 
delay  as  bandwidth  increases. 

The  five  parametric  combinations  indicating  acceptable 
performance  were  selected  for  further  examination.  Four  additional 
test  runs  were  made  for  each  case  with  random  number  seeds  as  shown 
in  Table  D-4  selected  from  a  randan  number  table  (Lapin  1975) .  The 
runs  were  repeated  with  different  random  numbers  for  the  same  sample 
size  to  give  a  set  of  independent  determinations  of  the  sample  mean 
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Tabla  5.1.  Global  Sua  Natwork  Partormanca 


RUN 

PROCESSOR, 

MIPS 

MESSAGE 

ARRIVAL 

RATE, 

MSEC 

band 

WIDTH, 

MEGABITS 

PERFORMANCE 

0  512 

0.2 

50 

1 

NOT  ACCEPTABLE 

0514 

0.4 

50 

1 

NOT  ACCEPTABLE 

0516 

O.S 

50 

' 

ACCEPTABLE 

0522 

0.2 

50 

2 

NOT  ACCEPTABLE 

0524 

0.4 

50 

2 

NOT  ACCEPTABLE 

0526 

0.6 

50 

2 

MARGINALLY  ACCEPTABLE 

0532 

0.2 

50 

3 

NOT  ACCEPTABLE 

0534 

0.4 

50 

3 

NOT  ACCEPTABLE 

0536 

0.6 

50 

3 

ACCEPTABLE 

0542 

0.2 

50 

4 

NOT  ACCEPTABLE 

0544 

0.4 

50 

4 

NOT  ACCEPTABLE 

0546 

0.6 

50 

4 

ACCEPTABLE 

1012 

0.2 

100 

1 

NOT  ACCEPTABLE 

10  1  4 

0.4 

100 

1 

NOT  ACCEPTABLE 

101  6 

0.6 

100 

1 

NOT  ACCEPTABLE 

1022 

0.2 

100 

2 

NOT  ACCEPTABLE 

102  4 

0.4 

100 

2 

NOT  ACCEPTABLE 

1026 

06 

100 

2 

MARGINALLY  ACCEPTABLE 

1032 

0.2 

100 

3 

NOT  ACCEPTABLE 

1034 

0.4 

too 

3 

NOT  ACCEPTABLE 

1036 

0.6 

100 

3 

ACCEPTABLE 

1042 

0.2 

100 

4 

NOT  ACCEPTABLE 

1044 

0.4 

100 

4 

NOT  ACCEPTABLE 

1046 

0.6 

100 

4 

ACCEPTABLE 

Tabla  5-1.  Global  But  Notwork  Parformanca  (Cont) 


RUN 

PROCESSOR 

MIPS 

MESSAGE 

ARRIVAL 

RATE, 

MSEC 

BAND¬ 

WIDTH, 

MEGABITS 

PERFORMANCE 

2012 

0.2 

200 

1 

NOT 

ACCEPTABLE 

2014 

0.4 

200 

1 

NOT 

ACCEPTABLE 

2016 

0.6 

200 

I 

NOT 

ACCEPTABLE 

2022 

0.2 

200 

2 

NOT 

ACCEPTABLE 

2024 

0.4 

200 

2 

NOT 

ACCEPTABLE 

2026 

0.6 

200 

2 

NOT 

ACCEPTABLE 

2032 

0.2 

20  0 

3 

NOT 

ACCEPTABLE 

2034 

0.4 

200 

3 

NOT 

ACCEPTABLE 

2036 

0.6 

200 

3 

NOT 

ACCEPTABLE 

2042 

0.2 

200 

4 

NOT 

ACCEPTABLE 

2044 

0.4 

200 

4 

NOT 

ACCEPTABLE 

2046 

0.6 

_ 

20  0 

4 

MARGINALLY  ACCEPTABLE 

Table  5-2.  Global  But  Network  Simulation  Maaaaga  Delay  Data,  fi  Second*  Repeated  Run* 


Figure  5-1.  Global  But  Network  Simulation 

Mataaga  Dally,  jl  Saeonda  With  90% 
Confidence  Interval  -  Run  Number  0516 


Figura  5-2.  Global  But  Natwork  Simulation 

Moaaaga  Delay,  H  Sacond*  With  90% 
Confldanca  Intarval  -  Run  Numbar  0536 


iGE  DELAY,  fj.  SE 


Figure  5-4.  Global  But  Network  Simulation 

Meeaage  Delay,  fl  Seconds  With  90% 
Confidence  Interval  -  Run  Number  1036 


Figure  5-5.  Global  Bus  Network  Simulation 

Massage  Delay,  Seconds  With  901i 
Confidence  Interval  -  Run  Number  1046 


X 


(Gordon  1969).  The  results  of  these  runs  are  presented  in  Table  D-5. 
The  data  for  each  set  of  runs  were  then  used  to  determine  a  mean, 
variance  and  90%  confidence  interval  as  shown  in  Table  5-2.  A  sample 
calculation  is  provided  in  Appendix  D.  These  results  also  appear  in 
Figures  5-1  through  5-5. 

While  all  five  cases  had  an  overall  message  delay  well  below  the 
200  millisecond  time  objective,  only  one  case  met  the  300  millisecond 
delay  for  the  four-node  communications  path.  This  run,  number  0546, 
had  a  50  millisecond  message  arrival  rate,  a  4  megabit  bandwidth  and 
a  0.6,  MIPS  processor  capability.  Here,  the  increase  in  bandwidth 
from  3  to  4  megabits  affected  a  decrease  in  message  delay  time.  The 
3  megabit  case,  run  number  0536,  had  a  four-node  communication  delay 
slightly  above  300  milliseconds. 

The  large  difference  in  variances  in  cases  such  as  run  number 
0516  (three-node)  and  run  number  0546  (three-node)  caused  some 
interest.  This  situation  was  thought  to  be  due  to  the  variable 
number  of  transactions  occurring  in  the  simulation  of  the  two-, 
three-,  and  four-node  message  paths,  which  are  90.2%,  3.9%  and  5.9% 
of  the  transactions  respectively. 

Additional  sets  of  runs  were  made  for  these  two  run  numbers  with 
the  two-,  three-,  and  four-node  message  path  transactions  being  33%, 
33%  and  33%  respectively.  The  differences  in  variance  were  reduced 
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significantly,  i.e.  the  run  number  0516  (three-node)  variance 
decreased  from  8543  to  125  while  run  0546  (three-node)  variance 


increased  from  3  to  35.  Thus,  the  theory  that  the  difference  in 
numbers  of  transactions  contributed  greatly  to  the  variance  results 
was  substantiated.  Interestingly,  the  mean  message  delay  for  each  of 
the  reruns  varied  only  slightly  from  the  original  run  data. 
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6.0  CONCLUSIONS 


The  analysis  conducted  in  this  investigation  of  a  local  network 
topology  showed  that  the  global  bus  network  provides  superior 
performance  over  the  interconnection  and  ring  networks  where 
performance  is  based  on  average  message  delay  time.  Also,  short 
messages  performed  better  than  medium  and  long  messages. 

A  simulation  model  introduced  processor  delays  in  addition  to 
channel  delays  in  the  determination  of  average  message  delay  time. 

The  experiment  showed  that  the  fast  processor  (0.6  MIPS)  with  a  50- 
millisecond  message  arrival  rate  and  a  4-megabit  bandwidth  global  bus 
network  topology  is  satisfactory  for  the  application  under  study. 

The  overall  message  delay  time  is  less  than  200  milliseconds  and  the 
four-node  serial  communication  message  delay  time  is  less  than  300 
milliseconds. 

The  methodology  developed  in  this  paper  is  viewed  as  a  useful 
tool  in  the  system  design  process.  Software  requirements  are  first 
determined  based  on  the  functional  system  requirements.  After  the 
desired  system  response  time  is  determined,  the  software  and  hardware 
specifications  may  then  be  defined. 

As  computer  systems  change  rather  frequently  due  to  improvements 
and  modifications,  the  techniques  developed  in  this  analysis  and 
simulation  have  further  application  in  that  they  provide  for  an 
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assessment  regarding  network  performance  due  to  proposed  changes. 
Another  variation  of  the  network  performance  analysis  problem  would 
be  to  fix  one  of  the  parameters  such  as  processor  capacity,  assuming 
only  one  processor  is  available  for  an  application,  and  vary  the 
bandwidth  and  message  arrival  rate  parameters  until  a  satisfactory 
message  delay  time  is  found. 

A  logical  extension  of  this  effort  would  be  to  merge  the  analysis 
and  simulation  programs  into  a  single  program  capable  of  handling  n 
nodes  and  i  links  or  channels.  Added  to  this  would  be  an  interactive 
capability  with  a  display  console  for  input/ouput  resulting  in  an 
improved  software  tool  for  utilization  in  the  design  of  advanced 
computer  systems. 

An  expansion  of  the  global  bus  simulation  could  include  a 
replication  of  the  global  bus  and  a  traffic  controller  to  regulate 
the  flow  of  messages  over  each  bus. 
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APPENDIX  A 


DATA  TABLES 


A.O  General  Tables 


Table  A-l.  Message  Traffic  Flow  Matrix.  This  table  illustrates 
the  node-to-node  traffic  requirements.  For  example,  and  "x"  in 
location  (1,2)  indicates  data  must  flow  from  source  node  1  to 
destination  node  2. 

Table  A-2.  Node  Data  Field  Traffic  Requirements.  The  Node  Data 
Field  Traffic  Requirements  Table  shows  the  actual  data  field  require¬ 
ments.  The  data  tables  in  each  node  which  have  data  fields  set  and 
used  by  modules  resident  in  the  node  are  identified.  Thus,  the 
traffic  requirements  can  be  determined.  For  example,  node  1  uses  791 
data  fields/second  and  sets  400  data  fields/second  in  table  FTDDSVT. 
Nodes  2,  4,  5,  6,  8,  and  9  use  data  from  FTDDSVT.  Thus,  400  data 
fields/second  are  transmitted  to  these  nodes  from  node  1.  Node  4 
sets  20  fields/second  in  this  table  and  so  20  fields/second  are 
transmitted  to  nodes  1,  2,  5,  6,  8,  and  9.  As  a  copy  of  all  tables 
is  maintained  in  the  data  base  controller  (node  3)  the  400  and  20 
data  fields/second  are  sent  to  node  3  also  (Bryden  1979) . 

Table  A-3.  Network  Traffic  Matrix.  This  table  provides  three 
entries  for  each  source-destination  combination.  These  are  all  given 
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in  data  bits/second  without  overhead  for:  16-bit  data  fields 

32-bit  data  fields 
32-bit  control  messages 

The  entries  in  location  (1,3)  are  obtained  as  follows: 

5232  data  fields/second  X  16  bits/field  *  83712  bits/second 
1480  data  fields/second  X  32  bits/field  ■  47360  bits/second 
10  messages/second  X  8  fields/message  X  32  bits/field  =  2560 
bits/second. 

Table  A-4.  Data  Fields  Traffic  Matrix.  This  table  is  merely  a 
summation  of  the  data  fields  presented  in  Table  A-2.  Example:  A 
summation  of  the  data  fields  transmitted  from  node  1  to  node  2  in 
Table  A-2  is 

Z  »  400  +1130  +  12  +  6  +  420  +  8  +  195 

*  2171  data  fields/second  and  this  value  appears  in  location 
(1,2)  of  Table  A-4.  Also  appearing  is  the  value  of  10 
system  control  messages/second. 

Tables  A-5,  A-6  and  A-7.  Network  Traffic  Matrix.  These  tables 
give  the  number  of  short,  medium  and  long  messages/second,  respec¬ 
tively,  for  the  data  in  Table  A-3.  Calculations  to  obtain  the  data 
for  location  (1,3)  are  given  for  each  table: 

Table  A-5.  (83712  bits/second)  (16  words  X  32  bits/word) 

■  163.5  messages/second 

(47360  bits/second)  (16  words  X  32  bits/word) 

*  92.5  messages/second 
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(2560  bits/second)  —  (16  words  X  32  bits/word) 

=  5  messages/second 

Table  A-6.  (83712  bits/second)  —  (32  words  X  32  bits/word) 

=  81.75  messages/second 

(47360  bits/second)  H-(32  words  X  32  bits/word) 

=  46.25  messages/ second 

(2560  bits/second)  -r-  (32  words  X  32  bits/word) 

=  2.5  messages/second 

Table  A-7.  (83712  bits/second)  — (64  words  X  32  bits/word) 

*  40.88  messages/second 

(47360  bits/second)  H-  (64  words  X  32  bits/word) 

*  23.13  messages/second 

(2560  bits/second)  -r-  (64  words  X  32  bits/word) 

*  1.25  messages/second 


A.l  Interconnection  Network  Tables 


Table  A-8.  Interconnection  Network  Node-Node  Message  Routing. 
This  table  illustrates  the  route  each  message  takes  as  it  goes  from  a 
source  node  to  a  destination  node.  For  example,  location  (2,7) 
contain  the  entry  2-S-6-7.  In  this  case,  messages  going  from  source 
node  2  to  destination  node  7  pass  through  the  node  interfaces  at 
nodes  5  and  6  prior  to  arriving  at  node  7. 
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Table  A-1.  Meaaage  Traffic  Flow  Matrix 


FTPL48  30/80  41/370  4/60 

FTCSSHT  420/12  3/5  1/2  3/5 

FTKPMTRX  0/21 


Table  A-2.  Nod*  Data  Field  Tralllc  Raqulramanla,  Fields  I  Second  (Coni.) 


FT08TAC 

FTGEREM 

FTOVER 


Table  A-2.  Node  Data  Field  Tratlic  Requirements,  Fields  |  Second  (Coni.) 


Table  A-4.  Data  Field  Traffic  Ualrlx,  Field*  I  Second 

A.  fS-BH  Dale  Field 

B.  32-BH  Data  Field 
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Table  A-7.  Long  Message  Tralllc,  Message*  f  Second 

A.  16'BII  Data  Field 

B.  32-BII  Data  Field 


Table  A-9,  A-10,  and  A-ll.  Interconnection  Network  Link  Traffic. 
These  tables  contain  the  link  traffic  in  messages/second  (X^)  for 
short,  medium  and  long  message  lengths.  The  message  traffic  from 
Tables  A-5,  A-6,  and  A- 7  are  used  in  conjunction  with  the  interconnec¬ 
tion  network  message  routing  given  in  Table  A-8  to  arrive  at  a 

tabulation  of  X.  for  each  network  link. 

1 

A. 2  Ring  Network  Tables 

Table  A-12.  Ring  Network  Node-Node  Message  Routing.  This  table 
illustrates  the  route  each  message  takes  as  it  goes  from  a  source 
node  to  a  destination  node.  For  example,  location  (3,5)  contains  the 
entry  (3-4-5) .  In  this  case,  messages  going  from  source  node  3  to 
destination  node  5  pass  through  the  node  interface  at  node  4  prior  to 
arriving  at  node  5. 

Tables  A-13,  A-14,  and  A-15.  Ring  Network  Link  Traffic.  These 
tables  contain  the  link  traffic  in  messages/second  (X^)  for 
short,  medium  and  long  message  lengths.  The  message  traffic  data 
from  Tables  A-5,  A-6,  and  A-7  are  used  in  conjunction  with  the  ring 
network  message  routing  given  in  Tables  A-12  to  arrive  at  a 
tabulation  of  X.  for  each  network  link. 

Notes  The  data  traffic  flow  in  these  tables  is  designed  such 
that  if  the  same  message  packet  is  required  at  both  nodes  5  and  6  and 
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Table  A4.  Interconnection  Network 

Node-Node  Mexage  Routing 
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NETWORK  LINK 


TOTAL,  X|  97  117  61  82  74  8  356  24  118  74  127  68  80  50  78  54  54  38  119 


NETWORK  LINK 


TOTAL,  X,  I  50  I  61  I  31  I  42  I  38  I  5  179 


TOTAL, 


is  sent  from  node  3,  then  two  separate  transmissions  of  this  message 
packet  will  be  initiated  from  node  3. 

Table  A-17.  Network  Traffic  Matrix  with  Ring  Network  Modified 
Data.  This  table  provides  three  entries  for  each  source-destination 
combination.  Each  entry  is  given  in  data  bits/second  without 
overhead  for: 

16-bit  data  fields 
32-bit  data  fields 
32-bit  control  messages 

The  table  is  similar  to  Table  A-3. 

Tables  A-18,  A-19  and  A-20.  Network  Traffic  Matrix  with  Ring 
Network  Modified  Data.  These  tables  give  the  number  of  short,  medium 
and  long  messages/second,  respectively,  for  the  data  in  table  A-17. 
These  tables  are  similar  to  Tables  A-5,  A-6,  and  A-7. 

Tables  A-21,  A-22  and  A-23.  Ring  Network  Link  Traffic  with 
Modified  Data.  These  tables  contain  the  link  traffic  in  messages/ 
second  (X^)  for  short,  medium  and  long  message  lengths.  The 
message  traffic  trom  Tables  A-18,  A-19  and  A-20  are  used  in  conjunc¬ 
tion  with  the  ring  network  message  routing  given  in  Table  A-12  to 
arrive  at  a  tabulation  of  X^  for  each  network  link.  These  tables 
are  similar  to  Tables  A-13,  A-14,  and  A-15 
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Table  A-14.  Ring  Nelwotk,  Messages  I  Second 
Medium  Maacagaa 


TOTAL,  X|  I  537  495  366  321  304  242  214  232  192 


SOURCE  I  NETWORK  LINK 


DESTINATION  NODE 


I  ^  B  S  IB 

ZJ  I  I  i 

5  •  W  W 
t»  -n  **  «  » 

5  0... 

OC  2  <  CD  O 
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TOTAL,  X|  I  385  387  319  313  320  303  307  289 


Table  A-23.  Ring  Network.  Met aegee  I  Second 
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TOTAL,  X|  104  106 


A. 3  Global  Bus  Network  Tables 


Table  A- 24.  Global  Bus  Network  Node-Node  Message  Routing.  This 
table  shows  the  route  each  message  takes  as  it  goes  from  a  source 
node  to  a  destination  node.  For  example,  location  (6,8)  contains  the 
entry  (6-8)  indicating  a  direct  routing  from  the  source  node  to  the 
destination  node. 

Table  A-25.  Global  Bus  Network  Link  Traffic.  This  table 
contains  the  link  traffic  in  messages/second  (X^)  for  short, 
medium  and  long  message  lengths.  The  message  traffic  data  from 
Tables  A-5,  A-6,  and  A-7  are  used  in  conjunction  with  the  global  bus 
network  message  routing  given  in  Table  A-24  to  arrive  at  a  tabulation 
of  X  for  the  network  link. 

Note:  The  data  traffic  flow  in  these  tables  is  designed  such 
that  if  the  same  message  is  required  at  both  nodes  5  and  6  and  is 
sent  from  node  3,  then  two  separate  transmissions  of  this  message 
will  be  initiated  from  node  3. 

Table  A-26  Global  Bus  Network  Link  Traffic  with  Modified  Data. 
This  table  contains  the  link  traffic  in  messages/second  (X)  for 
short,  medium  and  long  message  lengths.  These  tables  are  similar  to 
Tables  A-21,  A-22,  and  A-23. 
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Note:  The  data  traffic  flow  in  Table  A-26  reflects  a  reduction 


in  the  traffic  to  take  advantage  of  the  global  bus  network  features. 
For  example,  if  a  message  is  required  at  both  nodes  5  and  6  and  is 
sent  from  node  3,  then  only  one  transmission  of  this  message  will  be 
initiated  from  node  3. 

Table  A-27  Global  Bus  Network.  Messages  Received  at  Node.  This 
table  contains  the  short,  medium  and  long  messages  received  at  each 
node. 
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i0URCE  destination  node 

node  ;  i  ~  I  ;  I  :  i  ~  r~ 


Tibia  A-27.  Global  Bus  Natworfc,  Maasagaa  /  Sacond 
Masaagaa  Racatoad  at  Noda 


9 


7S 


39 


21 


APPENDIX  B 


ILLUSTRATIVE  EXAMPLES 


B.O  Average  Message  Traffic  Illustrative  Examples 


The  total  average  message  traffic  through  each  of  the  links  is 


The  value  of  short  messages  for  the  interconnection  network  topology 
is 

X  =  97  +  117  +  61  +  82  +  74  +  8  +  356  +  24  +  118  +  74  +  127  + 

68  +  80  +  50  +  78  +  54  +  54  +  38  +  119 
X  =  1679  messages/second 

The  total  average  message  traffic  using  short  messages  for  the 
network  topology  is 

X  ■  1047  +  959  +  707  +  619  +  588  +  470  +  420  +  453  +  367 
X  =  5630  message/second 

B.l  Average  Message  Delay  Illustrative  Example 

An  example  of  a  solution  for  the  average  message  delay,  T,  is 
given  for  an  inter-connection  network  using  short  message  lenghts. 
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The  total  incoming  message  rate,  y»  for  the  network  is  defined 


^  ~  jk  ^jk 

Y  =  68  +  5  +  164  +  93  +  5  +  76  +  5  +  101  +  5  +  75  +  5  +  43  +  5  + 

63  +  5  +  68  +  5  +  1  +  3  +  1  +  1  +  1  +  1  +  1  +  0  +  94  +2+2  + 
4+28+2+1+2+4+2+2+1+2+2+12+61+11+46+ 
2  +  32  +  32  +  19  +  19  +  19  +  19  +  19  +  19  +  19  +  1  +  1  +  3  +  1  + 
1+1+1+1=  1287  messages/second 

Using  equation  (4-4)  and  substituting  the  following  is  obtained 


T. 

l 


=a 


1 

pC.  -  Ai 


T  =  - - - 

1  291839  -97 

576 

T^  =  0.002441  seconds 
In  a  similar  manner  the  values 

T2  -  0.002223 

T3  -  0.003078 

T .  -  0.002655 
4 

T5  -  0,002795 
T,  -  0.008500 
T7  -  0.001274 


are  obtained  for  the  other  links. 

T  *  0.002133 
Tu  *  0.002915 
T13  =■  0.002688 
T. ,  *  0.003400 
T15  *  0.002722 
T16  *  0.003272 
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A  DISTRIBUTED  COMPUTING  NLTwORK  FOR  REAL-TIME  SYSTEMS. (U) 

NOV  80  G  E  MORRISON 

UNCLASSIFIED  NUSC-TO-5932  * 


T_  =  0.004907 

O 


T1?  =  0.003272 


T.  =  0.002213  T,  =  0.003900 

9  18 

T, .  =  0.002795  T,  n  =  0.002204 

10  19 

The  average  message  delay,  T,  for  the  network  can  now  be 
determined  using  equation  (4-5)  revised  slightly 

T  =  ~  Z  X.T. 

Y  i  1  1 

T  =  ^287  [97  X  0*002441  +  117  X  0.002223  +  61  X  0.003078  +  82  X 

0.002655  +  74  X  0.002795  +  8  X  0.008500  +  356  X  0.001274  + 

24  X  0.004907  +  118  X  0.002213  +  74  X  0.002795  +  127  X 

0.002133  +  68  X  0.002915  +  80  X  0.002688  +  50  X  0.003400  + 

78  X  0.002722  +  54  X  0.003272  +  54  X  0.003272  +  38  X 

0.003900  +  119  X  0.0022041 


T  ■  0.003144  seconds/message 


B.2  Capacity  Allocation  Illustration  Examples 

The  equal  assignment,  proportional  assignment,  and  optimum 
assignment  capacity  computation  are  shown  in  the  following  paragraphs. 

B.2.1  Equal  Capacity  Assignment  Strategy 


A  network  containing  nine  links  and  a  total  capacity  of  five  megabits/ 
second  has  a  capacity  of  each  link  of 
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I 


Ci  *  C/M 


r  -  5x10 

i  "  9 


C^.  *  555,556  bits/second 


B. 2.2  Proportional  Capacity  Assignment  Stratec 


The  capacity  of  each  link  is  solved  using  the  equation 


C  X. 

C4 | prop  ■ 


The  capacity  for  link  1  of  the  ring  network  is 


Cjprop  • 


5x10  x  1047 
5630 


C^ | prop  *  929,840  bits/second 


B. 2.3  Optimum  Capcity  Assignment  Stratec 


The  optimum  capacity  assignment  for  each  link  is  found  by  using 


A.  CU-pjVX./p, 

°‘|op'  ■  sr  *  wr 

3  J 


An  example  follows  for  the  interconnection  network  using  short 
messages. 


The  traffic  intensity  parameter  for  this  case  is 


V 


i 

I 

A 

i 

I 

I 

I 

i 

i 

( 


0  , 

pc 

_  1679  x  576 
P  5  x  106 

p  -  0.1934 

Square  root  values  are  then  determined  as  follows: 

Z  X./p.  =  V97  x  576  +  \4l7  X  576  +V61  X  576  +  \/l4  X  576'  + 

j  33 

V8  X  576  +  V356  X  576  +  V24  X  576  +  Vll8  X  ^76  + 

V74  X  576  +  Vl27  X  576  +  V&8  X  576  +  \/80  X  576  + 

+  V50  X  576  +  V78  X  576  +  V54  X  576  +  \Z5*  X  576  + 

+  V38  xl76  +  Vll9  X  576 

*  236.37  +  259.60  +  187.45  +  217.33  +  206.46  +  67.88  + 

452.83  +  117.58  +  260.71  +  206.46  +  270.47  +  197.91  + 

214.66  +  169.71  +  211.96  +  176.36  +  176.36  +  147.95  + 

261.81 

*  4039.86 


Substituting  in  the  optimum  expression 


Zjopt 


97  X  576  + 


5  X  10  (1-0.1934)  236.37 
4039.86 


■  291839  bits/second 
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Similarly,  the  Cjopt  values  are  found  for 
links  of  the  interconnection  network. 


'10 


opt  *  326546  bits/second 
opt  •  222260  bits/second 
opt  *  264188  bits/second 
opt  *  248725  bits/second 
opt  *  72374  bits/second 
opt  *  757110  bits/second 
opt  *  131198  bits/second 
opt  *  248725  bits/second 
| opt  =  248725  bits/ second 


CU 1 0Pt  * 

Cu|opt  - 
Cu|opt  - 
CI4|opt  - 
Cl5jopt  - 
Ci6|opt  = 
C17|opt  - 

Cl8l°pt  * 

C19]opt  - 


the  remaining 

343154  bits/second 
236737  bits/second 
260374  bits/second 
298214  bits/second 
207164  bits/second 
207164  bits/second 
207164  bits/second 
169580  bits/second 
329904  bits/second 
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APPEND IC  C 


ANALYSIS  RESULTS 


C.O  General  Tables 


Table  C-l.  Average  Message  Delay ,  Seconds/Message/  Equal 
Capacity  Assignment  Strategy  with  Short  Messages.  This  table 
provides  a  tabulation  of  message  delays  by  network  bandwidth  and 
network  topology. 

Table  C-2.  Average  Message  Delay,  Seconds/Message,  Equal 
Capacity  Assignment  Strategy  with  Medium  Messages.  Message  delays  in 
this  table  are  given  by  network  topology  and  network  bandwidth. 

Table  C-3.  Average  Message  Delay,  Seconds/Message,  Equal 
Capacity  Assignment  Strategy  with  Long  Messages.  A  tabulation  of 
message  delays  by  network  bandwidth  and  network  topology  is  provided 
in  this  table. 

Table  C-4.  Average  Message  Delay,  Seconds/Message,  Proportional 
Capacity  Assignment  Strategy  with  Short  Messages.  This  table 
provides  a  tabulation  of  message  delays  by  network  bandwidth  and 


C- 


network  topology. 


Table  C-5.  Average  Message  Delay,  Seconds/Message,  Proportional 
Capacity  Assignment  with  Medium  Messages.  Messages  delays  in  this 
table  are  given  by  network  topology  and  network  bandwidth. 

Table  C-6.  Average  Message  Delay,  Seconds/Message  Proportional 
Capacity  Assignment  with  Long  Messsges.  A  tabulation  of  message 
delays  by  network  bandwidth  and  network  topology  is  provided  in  this 
table. 

Table  C-7.  Average  Messge  Delay,  Seconds/Message,  Optimum 
Capacity  Assignment  Strategy  with  Short  Messages.  This  table 
provides  a  tabulation  of  message  delays  by  network  bandwidth  and 
network  topology. 

Table  C-8 .  Average  Message  Delay,  Seconds/Message,  Optimum 
Capacity  Assignment  Strategy  with  Medium  Messages.  Message  delays  in 
this  table  are  given  by  network  topology  and  network  bandwidth. 

Table  C-9.  Average  Message  Delay,  Seconds/Message,  Optimum 
Capacity  Assignment  Strategy  with  Long  Messages.  A  tabulation  of 
message  delays  by  network  bandwidth  and  network  topology  is  provided 
in  this  table. 
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Table  C-1.  Avaraga  Maaaaga  Oalay,  Second*  /  Maaaaqa  (T) 
Equal  Capacity  A  alignment  Strategy 
With  Short  Menage* 


NETWORK  TOPOLOGY 


NETWORK 

BANOWIOTH, 

MEGABITS 

INTER¬ 

CONNECTION 

RING 

GLOBAL 

BUS 

RING 

(MOOlFIED 

DATA) 

GLOBAL 

BUS 

(M00IF1ED 

OATA) 

1 

.003772* 

-Oil  028 

-.001  123 

-.056081 

.000822 

2 

.010326* 

-.012514 

-.002027 

351756* 

.000339 

3 

.002272* 

-.059494 

-.010374 

.022112 

.000213 

4 

.032868 

.011161 

.003328 

.012323 

.000156 

s 

.008345 

.132716 

.001434 

.008572 

.000123 

10 

.001742 

.003733 

.000373 

.003410 

.000059 

20 

.000779 

.001397 

.pOO  150 

.001348 

000029 

NOTE'  I.  T  VALUES  INCLUOE  NEGATIVE  T,  VALUES. 
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Tib)*  C-2.  Average  M***ag*  Delay,  Seconds  /  Msssag*  (T) 

Equal  Capacity  Assignmont  Strategy  With  Medium  Mesaagea 


NETWORK 

BANOWIOTH, 

MEGABITS 

NETWORK  TOPOLOGY 

INTER¬ 

CONNECTION 

RING 

GLOBAL 

BUS 

RING 

(MOOIFIED 

DATA) 

GLOBAL 

BUS 

(MOOIFIED 

OATA) 

1 

-.024  IBS 

-.021749 

-.002207 

-.127564 

.001529 

2 

.019284' 

-.048891 

-.004112 

.328306 

.000636 

3 

.002786' 

.159854' 

-.030063 

.0400 1  3 

.000401 

4 

.025761 

.013130 

.005661 

.022760 

.000293 

3 

.009648 

.030293 

.002587 

.015952 

.000231 

10 

.003272 

.006925 

.000696 

.006410 

.000112 

20 

.001473 

.002624 

.000283 

.002921 

.000055 

NOTE*  I.  T  VALUES  INCLUQE  NEGATIVE  T,  VALUES. 


Table  C-3.  Averaga  Maaaaga  (May,  Saconda  /  Maaaaga  (T) 

Equal  Capacity  Aaaigninant  Stratagy  With  Long  Maaaaga* 


NETWORK 

BANDWIDTH, 

MEGABITS 

NETWORK  topology 

INTER¬ 

CONNECTION 

RING 

GLOBAL 

BUS 

RING 

(MODIFIED 

OATA) 

GLOBAL 

BUS 

(MOOIFIEO 

OATA) 

1 

.019857* 

-.040977 

-.003951 

-.214031 

.003008 

2 

.041680* 

-.051378 

-.006403 

-.186083 

.001241 

3 

.005835* 

.489298* 

-.016873 

.079216 

.000782 

4 

.044311 

.029779 

.026562 

.044341 

.000571 

3 

.018462 

.  1  18106 

.007432 

.030907 

.000449 

10 

.006393 

.013252 

.001615 

.012334 

.000218 

20 

.002888 

.005006 

.000630 

.005607 

.000107 

NOTE'  I.  T  VALUES  INCLUOE  NEGATIVE  Tj  VALUES. 
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Tibia  04.  Average  Maaaaga  Daily,  Saeenda  I  Mataaga  CD 

Proportional  Capacity  Aaalgnmant  Strategy  With  Short  Maaaagaa 


network 

8AN0WI0TH, 

MEGABITS 

network  topology 

inter¬ 

connection 

RING 

GLOBAL 

aus 

RING 

(MOOIFIEO 

DATA) 

1 

.434020 

-.010  1  1  1 

_ 

-.044614 

2 

.013823 

-.018246 

— 

.077898 

3 

.007023 

.093368 

— 

.020794 

4 

.004708 

.029932 

— 

.01 1999 

3 

.003340 

.012906 

— 

.008432 

10 

.001381 

.003356 

— 

.003392 

20 

.000730 

.001353 

— 

.001545 

NOTEi  I.  T  VALUES  INCLUDE  NEGATIVE  T,  VALUES. 
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Table  C-S.  Average  Muugi  Delay,  Seconds  /  Mnugi  (T) 

Proportional  Capacity  Aasignmant  Slratagy  With  Medium  Messagea 


NETWORK 

BANOWIDTH, 

MEGABITS 

NETWORK  TOPOLOGY 

INTER¬ 

CONNECTION 

RING 

GLOBAL 

BUS 

RING 

(M00IFIED 

OATA) 

global 

BUS 

(MODIFIED 

DATA) 

1 

.518730 

-.019864 

— 

.092430 

_ 

2 

.025806 

-.037010 

— 

.128096 

— 

3 

.013232 

-.270561 

— 

.037833 

— 

4 

.008897 

.050949 

— 

.022194 

— 

5 

.006702 

.023282 

— 

.015703 

_ 

10 

.003000 

.006267 

— 

.006377 

— 

20 

.001425 

.002546 

— 

.002915 

— 

NOTE:  I.  T  VALUES  INCLUOE  NEGATIVE  T;  VALUES. 


I 
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Tabla  C-6.  Average  Maaaaga  Oatay,  Seconds  /  Maaaaga  <T) 

Proportional  Capacity  Aaalgnmant  Stratagy  With  Long  Maasagaa 


NETWORK 

BANOWIOTH, 

MEGABITS 

NETWORK  TOPOLOGY 

inter¬ 

connection 

RING 

GLOBAL 

BUS 

RING 

(MOOIFIEO 

DATA) 

GLOBAL 

BUS 

(MOOIFIEO 

OATA) 

1 

2.6S574 

-.035561 

— 

-.168219 

__ 

2 

.052133 

-.057627 

— 

.264729 

— 

3 

.026333 

-.151863 

— 

.074077 

— 

4 

.017615 

.239055 

— 

.043063 

— 

5 

.013233 

.066885 

— 

.030335 

— 

10 

.005898 

.014537 

— 

.012262 

— 

20 

.002797 

.005667 

— 

.005594 

— 

NOTE:  I.  T  VALUES  INCLUDE  NEGATIVE  Tf  VALUES. 
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Taw*  C-7.  Avaraga  Maaaaga  Daiay,  Saconda  I  Maaaaga  (T) 

Optimum  Capacity  Aaaignmant  Slratagy  With  Short  Maaaagaa 


NETWORK 

BANOWIOTH, 

megabits 

network  topology 

INTER¬ 

CONNECTION 

RING 

GL08AL 

BUS 

RING 

(MOOIFIED 

DATA) 

global 

BUS 

(MOOIFIED 

OATA) 

1 

.385489 

-.009804 

— 

-.044345 

_ 

2 

.012277 

-.017692 

— 

.077429 

— 

3 

.006237 

-.090535 

— 

.020670 

— 

4 

.004181 

.029043 

— 

.011927 

— 

s 

.003144 

.012514 

— 

.008382 

— 

10 

.001404 

.003254 

— 

.003371 

— 

20 

.000666 

.001312 

— 

.001535 

— 

NOTE*  I.  T  VALUES  INCLUDE  NEGATIVE  T,  VALUES. 
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Table  C-8.  Aitngi  Mmigi  (May,  Second*  /  Message  (T) 

Optimum  Capacity  Assignment  Strategy  With  Medium  Massage* 


network 

BANDWIDTH, 

MEGABITS 

NETWORK  TOPOLOGY 

INTER¬ 

CONNECTION 

RING 

GLOBAL 

BUS 

RING 

(MODIFIED 

OATA) 

GLOBAL 

BUS 

(MOOIFIED 

OATA) 

1 

.464553 

-.019264 

— 

-.091864 

— 

2 

.023  1 1 0 

-.035892 

— 

.127311 

— 

3 

.011850 

-.262390 

— 

.037600 

— 

4 

.007968 

.049409 

— 

.022058 

— 

S 

.006002 

.022579 

— 

.015607 

— 

10 

.002687 

.006078 

— 

.006338 

— 

20 

.001277 

■002469 

— 

.002897 

— 

NOTE:  I.  T  VALUES  INCLUOE  NEGATIVE  T,  VALUES. 
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Table  09.  Average  Maaaaga  Datay,  Saconda  I  Maaaaga  (T) 

Optimum  Capacity  Aaalgnmant  Strategy  With  tong  Mesaagae 


NETWORK 

BANOWtDTH, 

MEGABITS 

NETWORK  TOPOLOGY 

INTER¬ 

CONNECTION 

RING 

global 

BUS 

RING 

(MODIFIED 

DATA) 

global 

BUS 

(MOOIFIEO 

OATA) 

1 

2.40618 

-.030334 

_ 

-.167108 

- 

2 

.047253 

-.049156 

— 

.262980 

— 

3 

.02386 1 

-.129540 

— 

.073587 

— 

4 

.015960 

.203915 

— 

.042779 

— 

S 

.011990 

.057053 

— 

.030154 

— 

10 

.005344 

.01 2400 

— 

.012180 

— 

20 

.002534 

.004834 

— 

.005557 

— 

NOTE*  I.  T  VALUES  INCUIOE  NEGATIVE  T,  VALUES. 
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APPENDIX  D 


SIMULATION  RESULTS 


D.O  General  Tables 


Table  D-l.  Node  Instructions  per  cycle.  This  table  provides  a 
tabulation  of  the  number  of  instructions  per  cycle  for  each  node  is 
the  global  bus  network  (Burke  1980) . 

Table  D-2.  Node  Processing  Times,  Seconds.  The  number  of 
instructions  executed  per  cycle  divided  by  the  processing  capability 
in  million  instructions  per  second  results  in  the  node  processing 
times  presented  in  this  table. 

Table  D-3.  Global  Bus  Network  Simulation,  Mean  Message  delay, 
y  seconds,  using  RN1  Random  Number  Seed.  Data  from  thirty-six  runs 
are  presented  including  overall  mean  delay,  two-,  three-,  and 
four-node  mean  delays. 

Table  D-4.  Random  Number  Seeds.  The  random  number  seeds 
included  in  each  set  are  shown  in  this  table. 

Table  D-5.  Global  Bus  Network  Simulation,  Mean  Message  Delay, 


y  seconds.  The  results  from  five  runs,  each  with  a  different 
random  number  set,  are  given  for  each  run  number  case. 
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Table  0*1.  Node  Inatructlon  Per  Cycle 


NODE 

NUMBER  OF 

INSTRUCTIONS 

PER  CYCLE 

1.  SENSOR  DATA  PROCESSOR 

‘  42710 

2.  target  motion  ANALYSIS 

63860 

3.  OATA  BASE  CONTROLLER 

21790 

4.  TIME  BEARING 

33260 

3.  WEAPONS  COMMUNICATIONS 

CONTROLLER 

33200 

6.  OPERATIONS  SUMMARY 

37700 

7.  WEAPONS  PRESET 

31780 

3.  GEOGRAPHIC 

34740 

9.  TARGET  MOTION  ANALYSIS 

63860 

Ttbl*  0-2.  Nod*  Proc**»lng  Tim**,  Second* 
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D.l  Figures 


Figure  D-l.  Global  Bus  Network  Simulation,  Overall  Mean  Message 
delay,  p  seconds,  using  RN1  Random  Number  Seed.  The  message  delay 
is  plotted  for  each  run  in  the  -50  millisecond  message  arrival  interval 
series. 

Figure  D-2.  Global  Bus  Network  Simulation,  Overall  mean  Message 
Delay,  p  seconds,  using  RN1  Randon  Number  Seed.  The  message  delay 
is  plotted  for  each  run  in  the  100  millisecond  message  arrival 
interval  series. 

Figure  D-3.  Global  Bus  Network  Simulation  Overall  Mean  Message 
Delay,  p  seconds,  using  RN1  Random  Number  Seed.  The  message  delay 
is  plotted  for  each  run  in  the  200  millisecond  message  arrival 
interval  series. 

D.2  Mean,  Variance  and  90%  Confidence  Interval  Illustrative  Example 
(Gordon  1969) 
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